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Abstract 



The primary function of the Title I Technical Assistance Center (TAC) 
was to facilitate the implementation of the Title I Evaluation and 
Reporting System (TIERS). However, unanticipated outcomes could and do 
occur as a result of TAC activities. The objectives of this paper are to 
(a) depict the range of unanticipated outcomes that are likely to occu?^ 
or are knoWn to have occurred cunong TAC client groups, and (b) trace the 
etiology of the outcomes and discuss the^'^trapl^ications for future 
research. Data for the study cam^^rom field notes\ contact logs and 
personal experiences generated (from TAC site visits conducted in several 
western states during the past srx years. 
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INTRODUCTION 



The primary function of the Title 1 Technical Assistance Centers 
(referred to as TAG hereafter) is to facilitate the implementation of the 
Title 1 Evaluation and Reporting System (TIERS) in local school districts 
by providing technical assistance in evaluation to SEA and LEA personnel 
involved in Title 1 activities (Stonehill and Anderson, 1982^ Reisner, et 
ai.r 1982). TAG effectiveness is therefore measured by the extent to 
which a high-fidelity implementation of TIERS occurs in the school 
districts. The provision of technical assistance impinges, however, not 
only on the immediate TAG clientele but also on the evaluation community 
at large and the TAG staff thems^lves^ Unanticipated outcomes could and 
do occur as a result of TAG activities. The objectives of this paper are 
to (a) depict the range of unanticipated' outcomes that are likely to 
occur or are know to have occurred among TAG client groups, and 
(bj- trace the etiology of the outcomes and discuss their implications for 
research and evaluation of an extensive f^eral technical assistance 
effort such as TAG. Data for the present study ceupe from field notes, 
contact logs and personal experiences generated from TAG site visits 
conducted in several western states during- the past six years, .while 
these data tended to be anecdotal, patterns and trends of TAG 
outcomes — both anticipated and unanticipated — were clearly discernible in 
most cases. Intended outcomes of TAG services have been documented 




elsewhere (e.g., Millnan, et al., 1979? Reianer, et al., 1982). This 
paper focuses on outcomes not originally identified as part of the TAC 
mission. 

CLIENT DEPENDENCE 

As one of the most extensive federal efforts to build evaluation 
expertise at the local level, TAC's primary mission is to enhance local 
capacity for evaluation and eventually to decrease local dependence on 
external resources. An unanticipated outcome in this regard is that in 
some districts the reverse seems to be talcing place. These TAC clients 
attribute both problems and their solution to external sources — quite 
often to federal regulations or TAC itself, in some cases, the 
dependence is compounded by perceived third-party objectivity and trust 
(Schmuck, et al., 1972) attributed to TAC staff and by high turnover 
rates among SEA and LEA evaluation personnel, in other cases, state and 
local agencies have resorted to contracting external evaluators to " 
perform the required evaluations. 

Sound organizational development practices call for the training of 
internal trainers who can deliver various components of the program to 
new parts of the system (Miles, et al. , 1978). The multiplier approach 
of using external consultants to" train insiders who would in turn train 
others was included as part of the TAC overall strategies — even in the 
early years of.TAC before "local capacity building" was made an explicit 
objective of TAC work, in the face of increased |J:lient dependence, this 



objective obviously has not materialized. This certainly does not bode 
well for TAG clients should TAG be discontinued at soml future time. As 
Miles et al. (1978) point out;, programs which do not build internal 
capacity and/or which build up a dependency on external consultants are 
probably heading for trouble. 

GHAMGE AGENT ROLE 

TAG ^staff often serve as a catalyst for improved conmiunication among 
different client groups within a single client organization (e.g., 
between compensatory educatitjn program staff and evaluation staff) . /They 
are called upon to play the role of process linker (Piele, 1975; 
Firestone and Gorbett, 1981) among subgroups of clients within a client 
agency. Quite often, the only time when an inter-group dialogue occurs 
is when the groups are attending a TAG activity. 

During the early days of TAG many a measurement expert was hired by 
TAG to explain the functioning of TIERS to cli6nts. These experts 
quickly learned that the image and role of agent-of-change are often 
thrust upon them by the clientele. A new set of skills, is called for and 
the measurement experts quickly become public relations specialists. 
Effective political skills assume increased importance in ensuring a good 
TAC-client working relationship. It becomes necessary to base staff 
assignment on a combination of political and technical expertise which 
would best serve the client's needs. 

Like any change effort, TAG intervention could and do create 



potential conflicts of interest aitong various user groups within a client 
agency. For example, in some caaea^ TAG is perceived to be a surrogate 
contr9l system the uae of which could become an object of competition 
among different units or individuals within a client agency. In other 
cases, involvement with TAG might offer the incentive of broadening 
clients' professional horizon and exposure, iocluding out-of-state trips 
to attend TAG related conferences. In yet other instances, TAG could 
pose a potential threat to clients' career long^evity or advancement. 
However unfounded they may seem to TAG staff, such perceptions dQ exist 
where state or county level staff are hired to perform tasks which fall 
within the range of TAG services. These conflict phenomena are real and 
cannot be described away simply as symptoms of misunderstanding or poor 
interpersonal relationships. The conflicts, real or perceived, are not 
caused by blocks in conmunication or^ failures of interpersonal 
relations. Rather, they stem from problems of resource allocation, 
divergent values, and multiple goals. .In such cases, TAG work must be 
seen as part of a dynamic political process, growing put of the 
interaction aiibng different interest groups within a client organization 
and impinging on the decision-making process of the organization 
(Baldridge, 1972). In this perspective, TAG would primarily be 
interested in being responsive to its tasks of providing guidance and 
assistance to the SEAs and LEAs and only secondarily concerned with the 
self-fulfillment and actu<ilization of individual SEA/LEA staff. This 
mode of operation contrasts sharply with that of an expert conflict 
resolver who must keep the staff satisfied by defusing the conflict. 
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Organizational developnent theory accounts, at least in part, for 
successes and accomplishments of TAC in many areas. If TAG is seen as an 
outsider attempting to impose change on its client a^encies,^ strong 
resistance manifests itself in many subtle and disguised ways (Insel and 
Moosr 1974) . Such manifestations range from legitimate questioning of 
the technical adequacy of the TIERS and the evaluation models to a 
perfunctoAy iraplementation^f ain evaluation model to satisfy compliance 
requirements. Resistance to TAC work is leas where school adniniatratorsr • 
teachers, school board members an^ community leaders feel that the 
technical assistance agenda is their own, not devised and operated by an 
outsider. Where resistance exists, the degree of recalcitrance appears 
proportionate to the aaount of political clout the state is likely to 
wield with respect to Congress, its dependence on federal funding to 
operate the school system, and cultural factors. Large states with 
strong political clout tend to be the slowest in adopting the TIERS. ^ 
States which are least dependent on the federal government for 
educational funding tend to be least interested in TAC assistance. 
Partly because of cultural factors, most of the outlying territories are 
most eager to embrace the change in tjtir "evaluation process and to sQek 
TAC services to help institute the change. In such cases, an unequal 
status relationship typically exilj^ts in which* help flows from the 
superior (TAC) to the inferior (cJlient) , fostering deference and 
dependence on the part of th€f help recipient. 

Like any programs dealing with educational change, TAC may seem 
inefficient and costly (Millman et al., 1979). However, such is typical 
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of change efforts using hunan agents (Sieber, 1972) • If one were to 
consider only cost and "impact" of such, efforts one might well decide not 
to use human agents as a policy tool. The primary reason for using human 
agents is that the situations in which change is to occur are so complex 
that pn-site assistance is neceosary. Unless policy-makers understand 
the ci^plexity of the school situation, the point of using human agents 
as a policy variable may well be lost (Firestone and Corbett, 1981). 

TAG work embodies the concepts of organizational development from 
both the , human relations and political systems perspectives. The values 
and goals bf TAG work involve planned change, Ipng range attempts at 
, improving tWe quality of education of disadvantaged children as well as 
6l;ganizat|.^^al:' performance or productivity with the assistance of 
external change agents. It calls for technical and political skills and 
an orientation to working with power relations in the setting (Miles, et 
al., 1978) • The paragon of TAG staff would therefore possess skills in 
the following «reas: design and planning, entry and intervention, needs 
sensing, group facilitation, problem-solving, resource utilization, power 
and influence, communications, conflict management and resolution, and 
evaluation skills (COUREL, 1978) . 

ACADEMICS VS. PRACTITIONERS 

Many of the TAG staff are former academics. While TAG is primarily 
concerned with techncial consulting rather than management consulting, 
there is considerable overlap between "how to" and "what for" questions 
(Stanf ield, 1981) . A schism TAG staff are' required to bridge pertains to 
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the growing separation between acadenve and practice. The range of skills 
a^d^temperanent required for each are different, ranging from precision 
-^nd methodological sophistication in the case of research analyses to the 
more pragmatic, decision-oriented approach of technical assistance. In 
some cases this may lead to a teniiiion between the quest for scientific ' 
rigor and technical excellence on the one hand, and the desire to provide 
responsive, timely and effective help in reaching decisions on the 
other. The perspective of TAC staff is undoubtedly also influenced by 
current debates on whether the dominant realities of evaluation are 
political or technical. In the former point of view, evaluation is an 
intimate part of the political process and its success will be partly 
political (Pincus, 1980). In the latter viewpoint, methodological and 
coinunications improvements will lead to success (Boruch and Cordray, 
1980). In describing the widening gulf between ac^<ieme and the real 
world, Stanfield (1981) says: "The academic view of the subject is pure, 
exact-, permitting sophisticated methodologies sim^ified and 
abstracted settings. The real world is pragmatic, oriented towards 
useful results rather than thedretical purity, and constrained by time 
and coat". In this regard it is important to realize that TAC staff a*re 
primarily concerned with what is "doable" in the local dis/^ict setting 
rather than what constitutes the ideal. Furthermore, TAC staff are 
primarily concerned with client well-being rather than the advancement of 
knowledge. They serve first as providers of assistance and secondarily 
as promoter of science and knowledge. Academics are understandably often 
scornful^ of the pragmatic and eclectic approaches employed in the real 



w6rld. The client-centered approach of TAG staff is often at variance 
with the theoretical approach of the academic whose primary allegiance is 
to the advancement of knowledge through publication rather than to client 
well-being. ' 

EVALUATION USE 

In attempting to promote evaluation use, TAG staff and client groups 
have embarked on various projects on secondary analysis (Burstein, 1978) 
and data base studies, ^hese are often projects conducted independently 
of the main evaluation effort, i.e., the implementation of TIERS. As a 
result, there has been a proliferation of studies relating to evaluation 
use. These independent studies often represent an effective avenue 
through which evaluation use ia taking place. 

While promoting evaluation use is undoubtedly consistent with the 
overall TAG mission (Mlllman, et al., 1979; Alkin, et al., 1982), the 
extent of use of evaluation data among Title 1 projects is something of a 
pleasant surprise even to TAG staff themselves, in a recent national' 
survey, Alkln et al. (1982) concluded that both the Title 1 Bvalua^tion 
and Reporting System (TIERS) data and other types of Title 1 evaluation 
data were used at all decision levels by state education agencies (SEAs) 
and local education agencies (LEAs) . In their report to the U.S. 
Department of Education, the researchers maintained that the Title 1 
evaluation system did, indeed, have utility. They uncovered strong 
evidence that evaluation data were seen as an information source in the 



daily life cycle of Title 1 projects. Evaluation data contributed in 

incremental ways to major program decisions. At the SEA level, 

evaluation data were used to monitor LEA compliance, to recognize both 

> 

problem areas and exemplary programs and to influence administrative and 
curricular actions. LEAa typically used Title 1 evaluati<^ data to 
change attitudes and opinions toward Title 1 projects, to recognize 
situations requiring attention and to contribute to decisions on ^ 
administrative and curricular actions. \ 

The researchers found that different kinds of evaluatilin data had 
relative utility at the various organizational levels. School boards, 
district advisory committees and external agencies relied on aummative 
data, such as TIERS data, more extensively than other evaluation data. 
At the district administrative level, TIERS data were mixed about equally 
with other Title 1 evaluation data developed by the district. At the 
building level, principals, coordinators and the like relied slightly 
more on TIERS than on other data. At the classroom level, TIERS data 
were less often used. Instead, data more closely related to the 
instructional programs were preferred. 

Alkin et al. (1982) suggested several recommendations for improving 
evaluation utility as Title 1 became Chapter 1 in the new law. Th^y 
believed that Chapter 1 evaluation utility could be enhanced by continued 
technical assistance in reformatting "TIBRg-like" results to meet LEA 
information needs. Also, SEA and LEA evaluation units should be 
encouraged to design a variety of local decision-focused evaluation 
strategies. In particular, locally designed evaluation procedures might 



provide information on the impact and costs of various materials and 
processes within projects. 

The researchers pointed out that many local and state agency 

personnel required guidance in developing procedures to follow when 

" ' ' I ' * ^ — 

making decisions. It w^ not that administrators did not want to use 
relevant information. They^^Jp^cally did .not krfow how to incorporate the / 
information into their decision processes. Moreover, evaluators must 
become aware of the v|jteairrole their personal styl^ played iVevaluation 
utilizaton. Training procedures for evaluators might emphasize the 
evaluator's role and the importance of interpersonal skills. 

• ^' ' . ■ > . ' . 

\ ' KNOMLEDGE BASE - 
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In its six years of existence TAG has vastly increased the amount of 
literature on evaluation and relate technical issues. Hundreds of 
journal articles and technical papers have been generated on the 
evaluation models, testing, quality control, ^ata interpretation and 
eValuatiowuse, to name only a few topics. The work of the various 
inter-TAC committees covers an impressive array of technical issues. A 
vast amount of technical writing is presented in a vari^y of TAG related 
publications. 

TAC Clearinghouse, for instance, contains formally published research 
documents, infohnal reports^ in-s^vice training packages, an4 
audiovisuals. During the year^ enditig September 30, 1981 the 
Clear inibouse provided over 3,000 documents to Title 1 personnel 
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(Stonehill and Anderson, 1982). In addition, the Test Infonnat ion -Center 
provided specific information on the many tests being used across the 
coun1:ry for Title 1 evaluations. 

TAC staff have become an emergent, informal group with interacting 
leaders and day-to--day communication through informal jnedia and a 
commuting circuit of meetings and collaborative projects — all required 
idiosyncrasies of an invisible college (Paisley,- 1972) ^. A set of jargon 

kaa accordingly been developed, including such insular terms as TIERS, ' 

\? . - ■ ' 

CHIERSV ECT-I, NCE AND OOL. 

Armed with the' extensive knowledge base, TAG staff h^^ve served as^ 
links between the invisible qellege and TAC clients. It is fully 
expected that the cyjthorit^tiveness and prestige of the invisible college 

i Li. ■ 

and the interpersonal effectiveness of the linkers will lead to rational 
change in the nation's schools. 

<- ■ 

MATERIALS DEVELOPMENT i 

TAC materials development has undergone scunething of an evolution. 
In the early days of TAC operation it was not uncemnon for TAC staff to 
be equipped with a 50-page script to be (and did get) read verbatim at a 
workshop. Materials were highly technical — loaded with formidable 
looking formulae and computional procedures. These materials were 
quickly discarded when^ey proved to be impractical and ineffectual. 
Hour-long lectures on NCEs were replaced by the more down-to-earth "NCEs 
are a newj^ype of test scores somewhat like percentiles but with equal 
units." Uniformity began to give way to diversity and practicality. The 
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length of workshops has also undergone a radical change* -Early days of 

TAC witnessed six- to eight-hour long standardized lectures on TIERS and 

related topics. ^ Diversity has called for much shorter discussions on 

more immediate concerns. 

The. era pf diversity was, however, somewhat short-lived. 

Standardized workshop packages have regained promine;ice as more emphasis 

is now placed on inter-TAC collaboration on materials development. Most 

it 

major TIERS topics (e.g., functional level testing, needs assessment, 
implementation evaluation, sustained effects evaluation) have been 
papkaged as standard workshops. 

Non-TIERS TAC work has enjoyed more particifJnt involvment in 
selecting topics and specifying objectives and is highly effective. 
Workshops on test interpretation and time-on-task, for instance, are 
particularly successful because they offer concrete teacher-specific 
training, focus on practical problems, and are attended by principals 
among other project staff (McLaughlin ^nd Berman, 1977) . The inservice 
agenda is relevant to the participants who understand that the processes, 
skills and content they learned at the workshop can be used in the very 
near or immediate future (Orlich and Ezell, 1975) . 

TAC ACCOMPLISHMENTS 

All things considered, the fact that TAC has turned out to be a 
' success is something of a surprise in and of itself. The probability 
that any given change effort, in or out of school^ will be successful is 
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said to be .5 or less. Failures are as likely as successes (Miles, et i 
al., 1978). In this light, the finding of Millman et al. (1979) that TAG 
is working and working well must be regarded as a high commendation to 
TAC staff and those who sponsor and supervise their work. 

Moreover, contrary to previous findings that moderate change efforts 
with less reliance on external consultants are-^i^e readily 
institutionalized than large-s<pale programs, many aspects of TAG work 
(e.g., TIERS in?>lementation) appear to have been incorporated in the 
administrative structure of the client agency. Evidence of this 
acceptance and incorporation is seen in the recent efforts of ^he state 
Chapter 1 coordinators to continue the use of TIERS when new federal 
guidelines do not specifically require the use of the system. 

Although local capacity remains a goal to be realized, a good start 
in the right direction has already been made in many SBAa. Perhaps as a 
consequence of witnessing the successes which TAC has had in working with 
the LEAS, many state agencies have begun to think in terms of providi^*/^^*^^^ 
technical assisjbance to LEAs in such areas as program operation and 
improvement rather than in terms of compliance monitoring. This renewed 
emphasis on the service function, as opposed to the regulatory function, 
of the agency augurs well for the4iiqprovement of educational programs not ^ 
only for the disadvantaged but also for the general student population. 
As Berman and McLaughlin (1978) point out, the ability of the state to 
nurture local district development will be a key to long-term prospects 
for educational improvement. Despite significant weaknesses among SEAs, 
they, rather than federal agencies, have the potential to supply support 
and assistance to the change process, implementation and capacity 
building in the local districts, 

16 . 
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, Both anticipated and unanticipated outcomes of TAG work may be viewed 
from models of helping conceptualized by Brickman et al. (1982) . The 
conceptualization consists of four models: moral, compensatory, medical 
>pnd enlightenment. In the moral model, people are attributed 
responsibili^ for both creating and solving their problems. In the 
compensatory model, people are not blamed for their prob^lema but are held 
responsible for solving the problems. The medical roodel\holds people 
responsible for neither their problems nor the solutions\3 The 
enlightenment model puts the blame on people for causing their probleiim 
but does not hold them responsible for solving the problems.' The four 
models are depicted as follows: 



People responsible for problem? 







Yes 


No f 


People responsible 


Yes 


Moral 


Compensatory 


for solution? 










No 


Enlightenment 


Medical 
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Events leading to the establishment of "piSZ and its functions suggest 
that the medical model most closely embodies its rationale and 
assumptions. taC clients — SEA and LEA personnel — are not seen as 
responsible for the state of affairs (e.g., non-<:omparable and 
non-aggregatable evaluation results) which led to the development of 
'i'lERS and the establishment of TAG. Nor was it believeSi that they should 
be held responsible for the solution. TAC clients see themselves and are 
seen by others as blameless and are expected to need expert help. The 
help givers believed necessary to bring about a better state of affairs 
are experts who have been trained to recognize what the problem is anji to 

provide What service .or treatment is available. Even when the solution 

i 

is largely one that TAC clients can or must carry out themselves, the 
responsibility for prescribing the solution and for judging whether it 
hab been successful rests with ttie outside expert (Qrlckman et al., 1982). 

The advantage of the medical fnodel from the client's standpoint is 
that it allows people**to claim and accept help without being blamed for 
their problems, ih the context of TAC, SEAs and LEAs are not responsible 
for the- problem and cannot be expected to take, care of it by themselves. 
Indeed, many do not see the problem (e.g., non-aggrega table evaluation 
results) as their problem as much as a problem of the federal education 
agency*: The disadvantage of the medical model is that it fosters 
dependency (Brickman et al., 1982). Thus, th^more SEAs and LEAs see the 
problem as having originated at the federal level the more they feel 
comfortable depending on TAC for its solution. The risk is of course 
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that once they are made to feel dependent on others, they may lose the 
desire or ability to do even things that they once did well. They may 
even "learn" to accept inadequate or coercive intervention since they see 
no way of (and- no reason for) solving the problem themselves. 

Attributing responsibility for solutions to an extental agent usually 

lead to temporary^ rather than permanent, improvement (Brickman et al, 

I- ■ 

1982). The improvement is maintained only so long as the external. agent 
is salient (Kelman, 1958) . Improved behavior is more likely to persist 
when people see it as intrinsically determined rather than determiped by 
external forces (deCharma, 1968; liepper and Greene, 1978). According to 

r 

Brickman et al., 1982, the dilemna of helping may be' resolved by using 
the compensatory model which justifies the act of helpirig (since 
recipients are not responsible for the problem), and yet provides help 
recipients with an active sense of control (singe they are held 
responsible for using the help to find solutions) . \ 

Undoubtedly, not all SEAs and LBAs see tiieir interaction with TAG as 
an exemplification of the moral model. Many can and do function 
according to the compensatory model. What would be of most interest 
would be the identification of factors which determine the choice or 
emergence of a particular model in different states and the effects of 
each model in given situations. Specifically, the pertinent research 
questions include: ^ 

1. What models appear to exist in the different TAG client states? 

2. Given the TAG objectives, which model is best for TAG staff? 

3. Given the TAG objectives, which model is best for TAG clients? 
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Is one model unifoi^ily better than the others? 
Should different models be used as TAG work progresses? 
Do the federal agency, TAG and client states view the overall 
TAG effort with the same model? 

GONCLUOING REMARKS 

? 

The unanticipated outcomes have obvious implications on TAG including 
its overall missionr staff selection and internal TAG functibns such as 
materials development. They also point to larger issues which need to be 
addressed by the educational research and evaluation community. Among 
other things, these outcomes suggest the following questions for future 
research: Given comparable circumstances, what would be iKre 
cost-effective: a third-party evaluation or an evaluation performed by 
An ii^ernal staff? What would be the relationships, if any, between 
per-pupil evaluation cost and data quality and usefulness? what has been 
the impact of TIERS generated information and knowledge on educational 
evaluation in general? within the TAG context, what is the relative 
cost-effectiveness of standardized packages versus materials tailor-made 
to meet needs of individual client agencies? 



4. 

5. 
6. 
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